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Abstract 

A  chirp  transform  is  defined  for  the  A-step  LMS 
adaptive  predictors  for  linearly  chirped  signals 
embedded  in  additive  white  Gaussian  noise.  Ify 
converting  the  chirped  signals  to  stationary  baseband 
signals,  this  transform  provides  a  different  approach  in 
analyzing  the  tracking  performance  of  the  LMS  adaptive 
predictors.  This  tran.^form  also  provides  an  approach  of 
analyzing  the  nonlinear  effects  of  the  LMS  adaptive 
predictor  for  nonstationary  input  signals.  It  is  also 
.shown  that  the  chirp  tran.sform  con  be  applied  to  the  I- 
step  RLS predictor  with  chirped  input  signals. 


I .  Introduction 

The  tracking  behavior  oT  adaptive  filtering  algorithms 
is  a  rundamcntal  issue  in  dellning  their  performanee  in 
nonstationary  operating  environments.  The  convergence 
behavior  of  an  adaptive  llllcr  is  a  transient  phenomenon 
whereas  the  tracking  behavior  is  a  steady-state 
property|lJ.  |2|  studied  onc-step  Least-Mcan-Square 
(LMS)  adaptive  predictor  when  the  input  signal  eonsi.sts 
of  a  chirped  sinu.soid  in  Additive  White  Gaussian  Noise 
(AW(iN).  In  [3 1  the  performanee  of  the  one-step  LMS 
predictor  is  analyzed  when  the  input  is  a  chirped  first 
order  Autoregressive  proeess  (ARI)  embedded  in 
AWGN. 

Traditional  analysis  of  the  LMS  adaptive  filter 
performance,  including  the  analysis  in  the  above 
rclercnees,  is  restricted  to  a  statistical  analysis  of  the 
algorithm  under  a  set  of  independence  assumptions  that 
ignore  the  statistical  dependence  among  successive  tap- 
input  vectors  |4].  The  Mean-Squared  Error  (MSL)  of  the 
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LMS  adaptive  11  Iter  using  these  assumptions  is  bounded 
by  that  of  the  corresponding  finite-length  Wiener  filter, 
fhese  well-known  assumptions  mask  the  nonlinear 
effects  that  arise  in  LMS  adaptive  filters.  It  has  been 
shown  that  it  is  possible  for  the  LMS  adaptive  filter  to 
outperform  the  finite- length  Wiener  11  Iter  in  MSL  for  the 
ca.ses  of  adaptive  noise  cancellation  [5],  adaptive 
channel  equalization  [6],  and  adaptive  prediction  [7J[8J. 
An  error  transfer  function  approach  is  also  derived  in  16| 
to  give  an  approximate  expression  for  the  total  steady- 
state  MSB  of  the  LMS  adaptive  channel  equalizer.  A 
chirp  transform  is  defined  in  [71[81  to  convert  the 
chirped  ARI  signal  to  stationary  signal  and  approximate 
the  steady-state  MSL  of  the  LMS  algorithms  in  the 
transibrmed  domain. 

In  this  paper,  we  show  that  the  chirp  transform  defined 
in  171f8|  can  he  applied  to  multiple-step  LMS  predictors 
with  linearly  chirped  signal,  where  the  original  signal 
can  he  an  arbitrary  signal,  not  necessarily  ARI  process, 
■fhe  chirp  transform  will  convert  the  linearly  chirped 
signal  to  its  original  form,  and  the  analysis  of  steady- 
state  MSL  can  he  done  on  .stationary  signals.  The  chirp 
transform  ean  also  be  used  to  the  exponentially  weighted 
Recursive-Least-Scjuare  (RLS)  algorithm. 


2.  Hackgroiiiul 

The  adaptive  predictor  application  considered  is  the 
adaptive  recovery  of  narrowband  signals  from  embediled 
AWGN.  Fig.  1  represents  the  linear  A-step  adaptive 
predictor  strueture  to  be  analyzed,  where 
w‘'(a7)  =  •••  arc  the  adaptive  filter 

weights;  x"‘  is  the  input  to  the  adaptive  predictor, 
K  =  L 2,... ;  and  .v‘’  has  initial  center 

frequency  rn,,  and  chirp  rate  i// .  .9*  is  the  linearly 
chirped  signal  from  the  stationary  baseband  signal  .y„ , 
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(4) 


.v‘,  =  Q''M^  ^  n  =  0, 1, 2,... ,  where  Q  =  ,  and 

=  e"" . 

The  weight  update  equation  ol  thc  I. MS  algorithm  is 
w‘  (/?  +  !)  =  w'  (n)  +  //x‘*  (/?)<  ,  ( I ) 

where  //  is  the  step-size  parameter  of  the  adaptive 
algorithm,  is  the  adaptive  Ulter  input  tap-vector  at 

lime  index  /? ,  and  *  denote  the  complex  conjugate.  For 
the  A-step  predictor, 


+  Ox"  (/7  + 1) . 

where  w"(/?+I)  is  the  corresponding  predictor  weight 
in  the  transformed  domain  and  \"(/7  +  I)  is 
corresponding  imchirpcd  stationary  input  signal  vector. 
Note  that  for  the  imchirpcd  signal  jc"  =  .y^,  + /?" , 

,  77  =  0, 1,2,... . /?"  and  are  A  WON 
with  the  same  statistics.  ( I )  becomes 

W"  (77  +  I )  =  V/  [W"  (77)  +  //X"*  (77)<'  ]  ,  (5) 

where 


x‘(/7)  = 


The  error  update  equation  is  given  by 

Cl  -w‘'^‘(77  +  I)x‘(/7-f  I). 


(2) 


(3) 


3.  Chirp  Transform  for  LMS  Predictor 

I'he  error  transfer  function  approach  derived  in  [6] 
provides  a  method  to  approximate  the  total  .steady-slate 
MSF  of  the  I. MS  adaptive  llilcr  wilhoul  explicitly 
invoking  the  independence  assumptions  for  wide-sen.se 
stationary  input  signals,  i.e.,  .signals  with  a  fixed  PSD. 
For  a  chirped  input  signal  xl ,  the  PSD  is  constantly 
shifting  with  lime,  and  this  approach  is  not  directly 
applicable.  However,  by  multiplying  the  chirped  input 
.signal  by  a  negative  frequency  offset  sequence,  wc  can 
transform  the  chirped  signal  s';,  to  its  stationary 
baseband  form  s,,  and  leave  the  noise  component 

unchanged  in  staii.slics  .since  A  WON  has  a  constant 
spectral  envelope  aero.ss  all  frequencies.  In  the 
lollowing,  it  is  shown  that  the  above  transform  will  not 
change  the  MSti  ol‘  the  LMS  adaptive  predictor  for  a 
chirped  input  signal.  This  allows  the  error  transfer 
function  approach  to  be  applied  to  rotated  LMS 
algorithm  with  the  transformed  input  signals  in  order  to 
approximate  the  MSL  of  the  standard  LMS  adaptive 
predictor  with  chirped  input  signals. 


3.1  ICqiiivalciice  of  MSEs 

Multiplying  (3)  by  Q  2  ^  defining 

c"  =Q  "'F  ,  77  =  0,1,2,...  (3)  becomes 


'  *diag('F',M'\  -  (6) 

is  the  ehirp  rotation  matrix.  Since  e"  is  the  translormed 
version  of  ,  they  have  the  same  power,  i.e., 

1,1 

Consequently,  the  MSL  of  the  LMS  adaptive  predictor 
with  a  chirped  input  signal  .x',  is  equal  to  the  MSL  of  a 
different  LMS  adaptive  predictor  with  a  corresponding 
stationary  ba.scband  input  signal  x” .  The  two  adaptive 
predictor.s  have  the  same  length  M  and  stcp-si/.c  //  . 
Lquations  (4)  and  (5)  define  the  error  and  weight  vector 
updates  of  the  rotated  I. MS  adaptive  predictor,  fhe  only 
dilTcrcnce  between  these  equations  and  the  .standard 
LMS  adaptive  predictor  Ibr  stationary  input  signals  as  in 
(1)  and  (3)  is  that  the  weight  vector  is  rotated  in 
frequency  by  the  ehirp  matrix  V*  after  each  normal 
LMS  update,  as  shown  in  F'ig.  2. 


3.2  Error  Transfer  Function  Approach  for  the 
UcUated  LMS  Ada|)tivc  Fredicloi* 

Decompose  the  rotated  LMS  adaptive  predictor 
weight  into  the  sum  of  a  time-invariant  Unite-length 
Wiener  predictor  weight  and  a  lime-varying 
misadjiistment  component 

w"(7/)  =  w„  >  w;;,.^.r//).  tx) 

w“^^(77)  is  further  decomposed  as 

K...  ('0  =  (77)  +  w;;„^  (77) ,  (9) 

where  Is  die  mean  weight 

misadjustmcnl  corresponding  to  the  weight  nuclualion 
eau.scd  by  weight  rotation.  From  (.5).  the  mean  weight 
misadjiistment  is  given  by 


'VL  +  n  =  v;  (I  -  //  (n)  -  (I  -  v;  )w,  ,  ( 1 0) 

where  R  is  the  aulocorrclalion  matrix  of  ihc  stationary 
input  signal.  When  ,  i.e.,  the  adaptive  filter 

reaehes  steady  .state. 


where  A  =  V^-I.  Note  that  in  (10),  it  is  assumed 
to  be  independent  of  (n) ,  and  it  is  not 

neee.ssary  for  w"„(/7)  to  be  independent  of  x"(^).  This 
steady-stale  mean  weight  misadjiistment  term 
eorre.sponds  to  the  lag  weight  misadjiistment  of  the  LMS 
adaptive  predietor  with  a  ehirped  input  process  as  shown 
in|3]. 

The  weight  update  equation  (5)  ean  be  written  as 

w“(«)=v;”w"(o)+/(2v;<'’  .  (i2) 

^-0 


At  steady  stale,  V*''w"(0)  can  be  replaced  with 
w„+w",„,  thus  the  error  process  e"  satisllcs  the 
recursive  difference  equation 


=  <  -|"'o  +  <„  I' 


(13) 


I  Ising  the  approximation  |6] 

x‘’"(jn"(n)^ (14) 


II  nd 


A.*':' 

i;  «'!'  ^  I,  v/«i. 


(15) 


where  r"(k)  is  (he  aiilnconcla(ion  of  the  stationary 
input  signal  x" ,  wc  have, 


x''"(./)V;<"  ''x'’(/))  =  4/;-;(n  ./), 


(16) 


where 


,•;■(„ -7)^ 


(A. -''-Ik-  /I 

^  /•;'(/)-./).  (17) 


luiiiation  (13)  can  thus  be  approximated  by  a  standard 
dilferenee  equation  with  eonstant  eoeffieienls  as 


‘-'1'  +  =  xl  -I  w„  +  w’;„  .(18) 

7  .() 


We  can  interpret  the  steady-stale  (/?—>«>)  rotated  I.MS 
adaptive  predictor  error  e”  as  the  output  of  a  time- 
invariant  linear  .sy.stcm  with  transfer  function  //(z) 


driven  by  the  widc-sense  stationary  error  process 
+'v;,„fx"(/))- wbc're  l/(z)  is  given  by 


l  +  /(A//?(z)' 

where 

/?(2)=X;-;'(//i)2  (20) 

i»r  I 

The  steady-state  MSR  of  the  rotated  l.MvS  adaptive 
predictor  is  thus 

I'  ''-'-'’I’  ■'■■'■■’7  ■ 

where  ))'„(2)=  ^  .  <C(-)=  Z 

j^A  j^A 

the  transfer  functions  of  the  llnile-lcngth  Wiener  predictor 
and  mean  weight  misadjiistment  of  the  rotated  l-MS 
adaptive  predictor  respectively.  S‘’^(z)  is  the  PSD  of  the 
stationary  input  process  x" . 

fhe  error  transfer  function  approach  can  al.so  he 
applied  to  the  Normali/ed  I. MS  (NLMS)  algorithm  as 
defined  below  16] 

w'(;;  t  I)  -  w");;)  I  ^  ,  x‘'(;0<  (22) 

II  X  ('OH 

with 


fr(7.)  = - . 

l-(  flR{z)/il\  + PJ 


(23) 


4.  Chirp  rran.sform  for  KLS  Predictor 

In  this  section,  only  the  I -step  RLS  predictor  is 
studied  due  to  the  difllciilly  involved  in  the  inversion  of 
the  autocorrelation  matrix  estimate.  I'hc  weight  and  error 
update  equations  of  the  exponentially  w'cighlcd  KPS 
adaptive  algorithm  is  given  by  f4|  and  (3) 

w"(/7  +  1)  =  w‘  +  ,  (24) 

II 

where  fI>‘‘(A7)=  ^A"  'v"  (/7)x"'V/0  is  the  input  signal 

»^(j 

autocorrelation  matrix  estimate  at  lime  and  A  is  the 
forgetting  factor  of  the  RLS  algorithm. 

In  order  to  relate  the  inverse  of  aulocorrclalion 
estimations  hlT(/7)|  '  of  chirped  process  in  (24)  to  the 
autocoiTclation  e.stimale  [<I>„(/7)p'  of  the  baseband 


stationary  process  a*''  =  ,  use  steady-state 

approximation  (/?)]  ' ~  (1  -  ' »  ^nd  define  a 

signal  direction  matrix 

1  7^  ^ 

n  =  cliag|a  M'  '  }  (25) 

Then  at  steady-state, 

l<])‘;(,7)|-' =  v''"n  [(n^(/!)|  'n"v''""'  (26) 

where  V  =  .  (24)  beeomes 

w-(/i  + 1)  =  w‘(«)  +  V''‘'nf<I)^(/7)r'  D‘ V’<'""\''‘'(«)e:; 

It  can  be  simplified  to 

w''(n+l)  =  V‘fw''(«)  +  V  [<li,(/7)l  'v\''’(n)e;;i  (27) 

The  MSB  of  RLS  on  ehirped  proeess  ean  be 
approximated  by  the  MSB  of  fU.S  on  a  eorrespondenee 
stationary  baseband  proeess  with  an  adaptive  lllter  of 
the  same  length  M ,  forgetting  faetor  A ,  The 
dilTerences  of  equations  (4)  and  (27)  with  the  standard 
RLS  algorithm  for  stationary  signal  (3)  and  (24)  is  that 
the  weight  veetor  is  rotated  by  ehirp  matrix  V’  after 
each  update  and  the  inverse  of  aiitoeorrelation  matrix 
estimation  is  pre-rotated  hy  V  and  post-rotated  by  V  in 
each  update.  'I  hc  rotations  will  give  extra  MSB,  in  exeess 
of  the  normal  MSB  of  standard  Rl.S  algorithms. 

5.  Sinnilntions 

Several  simulations  have  been  performed  to  show  the 
equivalcnee  of  MSBs  using  chirp  transform  for  A-step 
LMS  predictor  and  l-step  RLS  predictor  ii.sing  the 
chirped  ARl  signals,  and  the  transfer  function  approach 
in  approximating  the  MSli  of  the  LMS  predictor  with 
chirped  ARI  signals. 

I'ig.  3  is  a  plot  of  MSlvs  of  Wiener  predictor,  standard 
LMS  with  chirped  ARl  input  signal,  and  rotated  LMS 
with  corresponding  stationary  input  signal.  The  signal  is 
pole  location  is  at  r/  =  0.9 ,  input  signal  SNR=5dB,  lllter 
length  A7=in,  the  prediction  di.stancc  is  5,  the  chirp 
rate  is  i//  =  5e-4.  it  shows  from  the  Big.  that  the  MSBs 

arc  e.ssentially  the  same  for  standard  LMS  on  chirped 
input  .signal  and  rotated  LMS  on  stationary  input  signal. 

Big.  4  plots  MSBs  of  40-slep  NLMS  predictors  as  a 
function  of  adaptation  constant,  with  SNR  =  20dB, 
M=25,  a  =  0.99,  chirp  rate  i//  =  57r£?-4 .  In  this  plot,  the 
Nl -MS  adaptive  predictors  are  used  instead  of  the 
standard  LMS  adaptive  predictors  because  the  NLMS 
algorithm  is  stable  for  relatively  larger  values  of  the 


adaptive  lllter  step-size  (0<//<2)  [6],  where  the 
nonlinear  effects  of  adaptive  algorithm  are  most 
signillcant.  The  most  significant  feature  of  the  plot  is 
that  the  LMS  predictors  can  have  smaller  MSBs  than 
tho.se  of  the  llnite-lcngth  Wiener  predictor.  This  is  due  to 
the  fact  that  adaptive  11  Iters  arc  nonlinear  filters,  'fhe 
results  from  transfer  function  approach  lit  well  to  the 
simulation  results  at  the  region  where  the  nonlinear 
effects  arc  most  signillcant.  'fhe  discrepancy  of  the 
MSl:s  predicted  by  transfer  function  approach  with 
simulation  results  at  smaller  adaptive  filter  step-size  is 
caused  by  approximations  used  in  (15),  where  the 
frequency  of  the  input  signal  vector  is  approximated  hy 
that  of  the  center  element  in  that  veetor. 

Fig.  5  plots  MSBs  of  Wiener  predictor,  standard  RLS 
with  chirped  ARl  input  signal,  and  rotated  RLS  with 
stationary  input  signal.  The  signal  pole  location  is  at 
a -0.9  ,  lllter  length  A/  =  10,  the  prediction  distance  is 
1,  chirp  rate  is  i//  =  5e-4.  It  can  he  seen  from  the  plot 
that  the  MSBs  of  standard  RLS  on  chirped  input  signal 
are  very  clo.se  to  the  MSlis  of  rotated  LMS  on  .stationary 
input  signal. 


6.  Conclusions 

A  transform  is  de lined  to  convert  the  chirped  input 
signals  to  haschand  stationary  input  signal.s,  thus 
provides  a  different  approach  in  analyzing  the  tracking 
performance  of  the  LMS  adaptive  prediettu's.  This 
transform  makes  it  possible  to  apply  the  error  transfer 
function  approach  to  chirped  input  signals  and  compute 
the  total  steady-state  MSB  of  the  LMS  adaptive 
predictors.  It  shows  that  for  narrowband  input  signal.s, 
whether  stationary  or  nonstationary,  embedded  in 
AWGN,  the  LMS  adaptive  predictor  may  outperform  the 
llnite-length  Wiener  predictor  in  steady-state  MSB'.  The 
.same  ehirp  transform  can  be  applied  to  the  1-stp 
exponentially  weighted  RLS  predictor  with  chirped 
input  signals. 
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F'igurc  I.  LMS/RLS  A-slep  predictor  slruclure. 
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Figure  3.  MSRs  of  Wiener  predictor,  standard  LMS  with 
chirped  ARl  input  signal,  and  rotated  LMS  with 
stationary  input  signal.  The  signal  pole  location  is  at 
r/ =  0.9 ,  filter  length  M  =  10,  the  prediction  distance  is 
5,  chirp  rate  is  i/a  =  5e-4. 
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Figure  4.  MSFs  of  40-stcp  NLMS  predictors  as  a 
function  of  adaptation  constant,  with  SNR  =  2()dB, 
M=25,  a  =  0.99,  chirp  rate  t//  =  Sne  -  4  . 
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I-igurc  2.  Rotated  LMS  A-slep  predictor  slruclure. 
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Figure  5.  MSFs  of  Wiener  predictor,  standard  RLS  with 
chirped  ARl  input  signal,  and  rotated  RLS  with 
stationary  input  signal.  The  signal  pole  location  is  at 
a  =  0.9  ,  niter  length  M  =10,  the  prediction  distance  is 
I ,  chirp  rate  is  1//  =  5c  -4. 


